Fidelity in complex behaviour change interventions : a standardised approach to evaluate intervention integrity

Objectives: The aim of this study was to (1) demonstrate the development and testing of tools and procedures designed to monitor and assess the integrity of a complex intervention for chronic pain (COping with persistent Pain, Effectiveness Research into Self-management (COPERS) course); and (2) make recommendations based on our experiences. Design: Fidelity assessment of a two-arm randomised controlled trial intervention, assessing the adherence and competence of the facilitators delivering the intervention. Setting: The intervention was delivered in the community in two centres in the UK: one inner city and one a mix of rural and urban locations. Participants: 403 people with chronic musculoskeletal pain were enrolled in the intervention arm and 300 attended the self-management course. Thirty lay and healthcare professionals were trained and 24 delivered the courses (2 per course). We ran 31 courses for up to 16 people per course and all were audio recorded. Interventions: The course was run over three and a half days; facilitators delivered a semistructured manualised course. Outcomes: We designed three measures to evaluate fidelity assessing adherence to the manual, competence and overall impression. Results: We evaluated a random sample of four components from each course (n=122). The evaluation forms were reliable and had good face validity. There were high levels of adherence in the delivery: overall adherence was two (maximum 2, IQR 1.67–2.00), facilitator competence exhibited more variability, and overall competence was 1.5 (maximum 2, IQR 1.25–2.00). Overall impression was three (maximum 4, IQR 2.00–3.00). Conclusions: Monitoring and assessing adherence and competence at the point of intervention delivery can be realised most efficiently by embedding the principles of fidelity measurement within the design stage of complex interventions and the training and assessment of those delivering the intervention. More work is necessary to ensure that more robust systems of fidelity evaluation accompany the growth of complex interventions

Achilles tendon rupture rehabilitation : a mixed methods investigation of current practice among orthopaedic surgeons in the United Kingdom

Abstract OBJECTIVES: The evidence base to inform the management of Achilles tendon rupture is sparse. The objectives of this research were to establish what current practice is in the United Kingdom and explore clinicians' views on proposed further research in this area. This study was registered with the ISRCTN (ISRCTN68273773) as part of a larger programme of research. METHODS: We report an online survey of current practice in the United Kingdom, approved by the British Orthopaedic Foot and Ankle Society and completed by 181 of its members. A total of ten of these respondents were invited for a subsequent one-to-one interview to explore clinician views on proposed further research in this area. RESULTS: The survey showed wide variations in practice, with patients being managed in plaster cast alone (13%), plaster cast followed by orthoses management (68%), and orthoses alone (19%). Within these categories, further variation existed regarding the individual rehabilitation facets, such as the length of time worn, the foot position within them and weight-bearing status. The subsequent interviews reflected this clinical uncertainty and the pressing need for definitive research. CONCLUSIONS: The gap in evidence in this area has resulted in practice in the United Kingdom becoming varied and based on individual opinion. Future high-quality randomised trials on this subject are supported by the clinical community. Cite this article: Bone Joint Res 2015;4:65-9. ©2015 The British Editorial Society of Bone & Joint Surgery. KEYWORDS: Achilles tendon; Orthotics; Plaster Cast; Rehabilitation; Ruptur

Identifying potential moderators for response to treatment in low back pain : a systematic review

Background: Identifying which patients with non-specific low back pain are likely to gain the greatest benefit from different treatments is an important research priority. Few studies are large enough to produce data on sub-group effects from different treatments. Data from existing large studies may help identify potential moderators to use in future individual patient data meta-analyses. Objective: To systematically review papers of therapist delivered interventions for low back pain to identify potential moderators to inform an individual patient data meta-analysis. Data sources: We searched MEDLINE, EMBASE, Web of Science and Citation Index and Cochrane Register of Controlled Trials (CENTRALhttp://www.cochrane.org/editorial-and-publishing-policy-resource/cochrane-central-register-controlled-trials-central) for relevant papers. Data extraction and data synthesis: We screened for randomised controlled trials with ≥500 or more participants, and cohort studies of ≥1000 or more participants. We examined all publications related to these studies for any reported moderator analyses. Two reviewers independently did risk of bias assessment of main results and quality assessment of any moderator analyses. Results: We included four randomised trials (n=7208). Potential moderators with strong evidence (p<0.05) in one or more studies were age, employment status and type, back pain status, narcotic medication use, treatment expectations and education. Potential moderators with weaker evidence (0.05<p≤0.20) included gender, psychological distress, pain/disability and quality of life. Conclusion: There are insufficient robust data on moderators to be useful in clinical practice. This review has identified some important potential moderators of treatment effect worthy of testing in future confirmatory analyses

Intra-articular facet joint injections for low back pain : a systematic review

Purpose: Evidence supporting the use of therapeutic intra-articular facet joint injections for patients with suspected facet joint pain is sparse. A systematic review including a narrative synthesis was carried out to determine if intra-articular facet joint injections with active drug are more effective in reducing back pain and back pain-related disability than a sham procedure or a placebo/inactive injection. Secondly, to determine if intra-articular facet joint injections with active drug or placebo/inactive injection are more effective in reducing back pain and back pain-related disability than conservative treatment. Methods: Medline, EMBASE, CINAHL, CENTRAL, Index to Chiropractic Literature and the Cochrane Central Register of Controlled Trials were searched from inception through April 2015. Data were screened and single extraction with independent verification and risk of bias assessment was performed. Results: A total of 391 records were screened, and six trials were included. The trials included were small (range 18–109 participants) and overall in terms of pain and disability outcomes most were inconclusive. Only two of the trials report any significant between-group differences in pain (mean difference −1.0, 95 % CI −2.0 to −0.1) and (p = 0.032) or disability (mean difference −3.0, 95 % CI −6.2 to 0.2) and (p = 0.013) outcomes. Conclusions: The studies found here were clinically diverse and precluded any meta-analysis. A number of methodological issues were identified. The positive results, whilst interpreted with caution, do suggest that there is a need for further high-quality work in this area

Whole home exercise intervention for depression in older care home residents (the OPERA study) : a process evaluation

Background: The ‘Older People’s Exercise intervention in Residential and nursing Accommodation’ (OPERA) cluster randomised trial evaluated the impact of training for care home staff together with twice-weekly, physiotherapist-led exercise classes on depressive symptoms in care home residents, but found no effect. We report a process evaluation exploring potential explanations for the lack of effect. Methods: The OPERA trial included over 1,000 residents in 78 care homes in the UK. We used a mixed methods approach including quantitative data collected from all homes. In eight case study homes, we carried out repeated periods of observation and interviews with residents, care staff and managers. At the end of the intervention, we held focus groups with OPERA research staff. We reported our first findings before the trial outcome was known. Results: Homes showed large variations in activity at baseline and throughout the trial. Overall attendance rate at the group exercise sessions was low (50%). We considered two issues that might explain the negative outcome: whether the intervention changed the culture of the homes, and whether the residents engaged with the intervention. We found low levels of staff training, few home champions for the intervention and a culture that prioritised protecting residents from harm over encouraging activity. The trial team delivered 3,191 exercise groups but only 36% of participants attended at least 1 group per week and depressed residents attended significantly fewer groups than those who were not depressed. Residents were very frail and therefore most groups only included seated exercises. Conclusions: The intervention did not change the culture of the homes and, in the case study homes, activity levels did not change outside the exercise groups. Residents did not engage in the exercise groups at a sufficient level, and this was particularly true for those with depressive symptoms at baseline. The physical and mental frailty of care home residents may make it impossible to deliver a sufficiently intense exercise intervention to impact on depressive symptoms

Implementing a hybrid cognitive-behavioural therapy for pain-related insomnia in primary care : lessons learnt from a mixed-methods feasibility study

Objectives: To test the feasibility of implementing a brief but intensive hybrid cognitive behavioural therapy (Hybrid CBT) for pain-related insomnia. Design: Mixed-methods, with qualitative process evaluation on a two-arm randomised controlled feasibility trial. Setting: Primary care. Participants: Twenty-five adult patients with chronic pain and insomnia. Intervention: Hybrid CBT or self-help control intervention. Primary and secondary outcome measures: Primary outcomes measures were the Insomnia Severity Index and interference scale of the Brief Pain Inventory (BPI). Secondary outcomes measures were the present pain intensity rating from the BPI, Multidimensional Fatigue Inventory, Hospital Anxiety and Depression Scale and EQ-5D-5L. Results: Fourteen participants were randomised to receive Hybrid CBT, 11 to receive the self-help control treatment. Of the 14 in the Hybrid CBT group, 9 (64%) completed all four treatment sessions (4 discontinued due to poor health; 1 due to time constraints). Adherence to the self-help control treatment was not monitored. The total number of participants completing the 12-week and 24-week follow-ups were 12 (6 in each group; Hybrid CBT: 43%; self-help: 55%) and 10 (5 in each group; Hybrid CBT: 36%; self-help: 45%). Based on the data available, candidate outcome measures appeared to be sensitive to changes associated with interventions. Thematic analysis of pre-postintervention interview data revealed satisfaction with treatment content among those who completed the Hybrid CBT, whereas those in the self-help control treatment wanted more contact hours and therapist guidance. Other practical suggestions for improvement included shortening the duration of each treatment session, reducing the amount of assessment paperwork, and minimising the burden of sleep and pain monitoring. Conclusion: Important lessons were learnt with regard to the infrastructure required to achieve better patient adherence and retention. Based on the qualitative feedback provided by a subset of treatment completers, future trials should also consider lowering the intensity of treatment and streamlining the data collection procedure. Trial registration number: ISRCTN17294365

An adaptive two-arm clinical trial using early endpoints to inform decision making : design for a study of sub-acromial spacers for repair of rotator cuff tendon tears

Background There is widespread concern across the clinical and research communities that clinical trials, powered for patient-reported outcomes, testing new surgical procedures are often expensive and time-consuming, particularly when the new intervention is shown to be no better than the standard. Conventional (non-adaptive) randomised controlled trials (RCTs) are perceived as being particularly inefficient in this setting. Therefore, we have developed an adaptive group sequential design that allows early endpoints to inform decision making and show, through simulations and a worked example, that these designs are feasible and often preferable to conventional non-adaptive designs. The methodology is motivated by an ongoing clinical trial investigating a saline-filled balloon, inserted above the main joint of the shoulder at the end of arthroscopic debridement, for treatment of tears of rotor cuff tendons. This research question and setting is typical of many studies undertaken to assess new surgical procedures. Methods Test statistics are presented based on the setting of two early outcomes, and methods for estimation of sequential stopping boundaries are described. A framework for the implementation of simulations to evaluate design characteristics is also described. Results Simulations show that designs with one, two and three early looks are feasible and, with appropriately chosen futility stopping boundaries, have appealing design characteristics. A number of possible design options are described that have good power and a high probability of stopping for futility if there is no evidence of a treatment effect at early looks. A worked example, with code in R, provides a practical demonstration of how the design might work in a real study. Conclusions In summary, we show that adaptive designs are feasible and could work in practice. We describe the operating characteristics of the designs and provide guidelines for appropriate values for the stopping boundaries for the START:REACTS (Sub-acromial spacer for Tears Affecting Rotator cuff Tendons: a Randomised, Efficient, Adaptive Clinical Trial in Surgery) study

The lived experience of chronic headache : a systematic review and synthesis of the qualitative literature

Objective To systematically review the qualitative literature of the lived experience of people with a chronic headache disorder. Background Chronic headaches affect 3%–4% of the population. The most common chronic headache disorders are chronic migraine, chronic tension-type headache and medication overuse headache. We present a systematic review and meta-ethnographic synthesis of the lived experience of people with chronic headache. Methods We searched seven electronic databases, hand-searched nine journals and used a modified Critical Appraisal Skills Programme checklist to appraise study quality. Following thematic analysis we synthesised the data using a meta-ethnographic approach. Results We identified 3586 unique citations; full texts were examined for 86 studies and 4 were included in the review. Included studies differed in their foci: exploring, patient-centred outcomes, chronic headache as a socially invisible disease, psychological processes mediating impaired quality of life, and the process of medication overuse. Initial thematic analysis and subsequent synthesis gave three overarching themes: ‘headache as a driver of behaviour’ (directly and indirectly), ‘the spectre of headache’ and ‘strained relationships’. Conclusion This meta-synthesis of published qualitative evidence demonstrates that chronic headaches have a profound effect on people’s lives, showing similarities with other pain conditions. There were insufficient data to explore the similarities and differences between different chronic headache disorders

Behavioural interventions for people living with adult-onset primary dystonia : a systematic review

Background: Primary dystonia is a chronic neurological movement disorder that causes abnormal muscle movements. Pain and emotional distress may accompany these physical symptoms. Behavioural interventions are used to help people with long term conditions improve their quality of life. Little is known about behavioural interventions applied to Dystonia. We report a systematic review of studies reporting current evidence of behavioural interventions for people with primary dystonia. Methods: We did systematic searches of Medline, PsycINFO, AHMED and CINAHL. We assessed the methodological quality of included studies using a risk of bias tool. Any disagreements were resolved by liaising with an independent rater. Physiological outcomes such as dystonia severity and psychological outcomes such as sleep and depression were selected on the basis that primary dystonia causes motor and non-motor symptoms. No time limit was placed on the searches. A narrative synthesis of the results is presented. Results: Of 1798 titles and abstracts screened, 14 full articles were retrieved and inclusion and exclusion criteria applied. Of these a final nine were eligible for the review (N = 73). Only two were Randomised Controlled Trials (RCTs). Using the Movement Disorders Society (MDS) dystonia classification, that was published after this work started, all of the included studies were of idiopathic adult onset focal dystonia without associated features. These included: blepharospasm (eye dystonia) (N = 1), cervical dystonia (neck dystonia) (N = 2), writer’s cramp (hand dystonia) (N = 3) and the yips (N = 3). No studies reported on dystonia that affects two or more body regions. Studies reported good adherence and response rates to treatment. Physiological and psychological improvements were noted in all studies at weekly, monthly and yearly follow-ups. Caution should be taken when interpreting the results because of the scarcity of RCTs identified, use of small sample sizes, and inappropriate statistical methods. Conclusion: We identified few studies; mainly of poor methodological quality that all studied a focal dystonia. It is not possible to draw firm conclusions. Nevertheless, the data suggests that a combined behavioural therapy approach including relaxation practice for people with idiopathic adult onset focal dystonia merits further investigation

Rational and design of an individual participant data meta-analysis of spinal manipulative therapy for chronic low back pain-a protocol

Background Chronic low back pain (LBP) is the leading cause of pain and disability, resulting in a major socioeconomic impact. The Cochrane Review which examined the effect of spinal manipulative therapy (SMT) for chronic LBP concluded that SMT is moderately effective, but was based on conventional meta-analysis of aggregate data. The use of individual participant data (IPD) from trials allows for a more precise estimate of the treatment effect and has the potential to identify moderators and/or mediators. The aim is (1) to assess the overall treatment effect of SMT for primary and secondary outcomes in adults with chronic LBP, (2) to determine possible moderation of baseline characteristics on treatment effect, (3) to identify characteristics of intervention (e.g., manipulation/mobilization) that influence the treatment effect, and (4) to identify mediators of treatment effects. Methods All trials included in the Cochrane Review on SMT for chronic LBP will be included which were published after the year 2000, and the search will be updated. No restrictions will be placed on the type of comparison or size of the study. Primary outcomes are pain intensity and physical functioning. A dataset will be compiled consisting of individual trials and variables included according to a predefined coding scheme. Variables to be included are descriptive of characteristics of the study, treatment, comparison, participant characteristics, and outcomes at all follow-up periods. A one-stage approach with a mixed model technique based on the intention-to-treat principle will be used for the analysis. Subsequent analyses will focus on treatment effect moderators and mediators. Discussion We will analyze IPD for LBP trials in which SMT is one of the interventions. IPD meta-analysis has been shown to be more reliable and valid than aggregate data meta-analysis, although this difference might also be attributed to the number of studies that can be used or the amount of data that can be utilized. Therefore, this project may identify important gaps in our knowledge with respect to prognostic factors of treatment effects